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Abstract 

The mean field spin glass model is analyzed by a combination of mathematically rigororous 
methods and a powerful Ansatz. The method exploited is general, and can be applied to others 
disordered mean field models such as, e.g., neural networks. 

It is well known that the probability measure of overlaps among replicas carries the whole 
physical content of these models. A functional order parameter of Parisi type is introduced by 
rigorous methods, according to previous works by F. Guerra. By the Ansatz that the functional 
order parameter is the correct order parameter of the model, we explicitly find the full overlap 
distribution. The physical interpretation of the functional order parameter is obtained, and 
ultrametricity of overlaps is derived as a natural consequence of a branching diffusion process. 

It is shown by explicit construction that ultrametricity of the 3-replicas overlap distribution 
together with the Ghirlanda-Guerra relations determines the distribution of overlaps among s 
replicas, for any s, in terms of the one-overlap distribution. 



1 Introduction. 



Mean field spin glass models are considered as a prototype of disordered, frustrated systems 
and, more generally, of a large class of complex systems that can be successfully analyzed 
using the ideas developed in the study of spin glasses [0, 15]. Among these, the Sherrington- 



Kirkpatrick model [jij has a primary importance. This model is by now well understood in its 
general features, as described by Parisi with an ingenious method and the ultrametric Ansatz [0J. 
This picture has been confirmed by extensive numerical simulations [14, 15 1 and some rigorous 
results H ||, [|, H ||, [0|. In particular, F. Guerra has given a rigorous motivation for the 
introduction of a functional order parameter of Parisi type, and has shown how in this framework 
a simple Ansatz allows to express the thermodynamic variables and some physical observables 
in terms of that order parameter ]|, |?]]. 

In the present paper, the Ansatz of Guerra is extended, and is developed a method to express 
all physical observables in terms of the functional order parameter, in a mathematically rigorous 
framework. The method is general, and can be applied to other mean field disordered models 
such as the multi-spin interaction spin glass and the neural networks. 

It is well known that the whole physical content of mean field spin glass models is contained 
in the overlap random variables. Given s replicas there are s{s — l)/2 overlaps between them, 
where s ranges on the natural numbers. Therefore, the physics of the model is fully contained 
in a probability distribution on an infinite-dimensional space. Overlaps do not fluctuate in the 
hight temperature phase : the Sherrington-Kirkpatrick solution turns out to be correct and the 
overlap distribution is trivial. In the low temperature phase this cannot happen : overlaps do 
fluctuate @, §,§,§]. 

Fluctuations are constrained by the symmetry under permutations of replicas and by the 
gauge symmetry. Thermodynamical constraints are expressed by Ghirlanda-Guerra relations, 
in the slightly stronger case when suitable infinitesimal interactions are added to the Hamil- 
tonian |||, 11] (this is also known as the stochastic stability property [o, 13 1). By the Ansatz 
that the overlap distribution is ultrametric, Parisi gave a solution of the model, in terms of a 
functional order parameter Q. Ultrametricity is a simple constraint on the support that con- 
siderably simplifies the overlap distribution : together with the previously stated constraints, 
it reduces the problem to the determination of the mono-dimensional, one-overlap distribution 
P\2- This is proven in the last section of this paper. 

A functional order parameter of Parisi type can be introduced rigorously to give a functional 
representation of the marginal martingale function, and therefore of the free energy ||. This 
representation is not unique : there is an infinite set of functional order parameters giving rise 
to the same free energy. By an Ansatz on this representation, some overlap correlation functions 
has been expressed through the functional order parameter j7|. In this paper, by an extension 
of the Ansatz, we explicitly find the full overlap distribution in terms of the functional order 
parameter, and we show how ultrametricity naturally emerges. 
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The method (and the paper) goes as follows. We introduce a generating functional of phys- 
ical observables (i.e., expectations of overlap functions), derived from the marginal martingale 
function (sect. |3|). Through the solution of a non-linear antiparabolic equation, and exploiting 
the Ansatz, we represent it in terms of the functional order parameter x (sect. |j). Then, we solve 
the antiparabolic equation by asymptotic expansion and explicitly find the overlap probability 
distribution. The physical interpretation of the functional order parameter is obtained, and 
ultrametricity of overlaps is derived as a natural consequence of the branching diffusion process 
underlying the equation (sect. ||). 

Finally, it is shown that complete ultrametricity of overlaps results from ultrametricity of the 
3-replicas overlap distribution. Moreover, it is proved that ultrametricity and the Ghirlanda- 
Guerra identities are complementary in order to determine the full overlap distribution, in the 
sense that one can hold independently of the other, but together they determine explicitly the 
overlap measure in terms of the one-overlap distribution P\2 (sect. ^). 

2 Overlaps in the Sherrington— Kirkpatrick model. 

The mean field model of a spin glass is defined on sites i = 1, 2, . . . , N. To each site is assigned 
the Ising spin variable o~i = ±1, so that a configuration of the system is described by the 
application a : i — > o~i & Z% = {— 1,1}. The spins on two different sites i and j are coupled 
through the random variables J™, all independent from each other and equally distributed. For 
the sake of simplicity we assume a Gaussian distribution, with 

E(J y )=0, E(4) = l, (1) 

where E denotes averages on the J variables. The Jjj's are called quenched variables, because 
they do not participate to thermalisation. The Hamiltonian of the Sherrington-Kirkpatrick 
model is 

H N (a, J) = = J H°i a h ( 2 ) 

where the sum extends over all the N(N — l)/2 couples of sites. The normalization factor l/y/N 
is needed to have the correct behavior of the thermodynamic variables in the limit N — > oo. 
Denoting with (3 the inverse temperature (in proper units), we introduce the partition function 
Zn((3, J) and the free energy density /jv(/3, J) ■ 

Z N (J3,J) = Yl e~? H ^ J \ (3) 

(T1...(TJV 

-(3f N ((3,J) = ^logZ N (P,J). (4) 
The associated Boltzmann state Wjvfl J is defined by 
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for a generic function A of the spin variables. Another relevant quantity is the average of internal 
energy density un(/3) 

u N {f3) = ±Eu; Nt p,j(H N (a, J)) = E^CSMA J)). (6) 

In the thermodynamic limit the free energy density is self-averaging in quadratic mean |J. 
For the internal energy density the same property has been proven for almost all values of (3, 
but is believed to hold without restrictions H . 

One of the main features of the mean field spin glass model is the existence of observables 
that do not self-average in the thermodynamic limit. This is one of the fundamental intuitions 
contained in the Parisi Ansatz of replica symmetry breaking. Indeed Pastur and Shcherbina 
have proven that if a suitably chosen order parameter (coming from the response of the system 
to an external random field) is self-averaging in the thermodynamic limit, then the solution of 
the model has the Sherrington-Kirkpatrick form ||, this is unphysical at high f3, because 
it gives negative entropy. Moreover, self-averaging of the Edward-Anderson order parameter 
implies that the overlap distribution is the trivial one corresponding to the replica symmetric 
Ansatz of S.-K. §. 

Let us consider s copies (replicas) of the system, whose configurations are given by the Ising 
spin variables , . . . , cr\ s \ and denote with Wj a \a = 1, 2, . . . , s the relative Boltzmann states, 
the dependence on (3 and N being understood. We introduce the product state fij by 

nj = Jpuf...4\ (7) 

where all the states uf are subject to the same values of the quenched variables J, and the 
same temperature (3. 

The overlap between the two replicas a and b, Q a b-, is defined by 

^ = ^E^M fc) ; (8) 

i 

with the obvious bounds — 1 < Q a b < 1- 

The importance of overlaps lies in the fact that all physical observables can be expressed in 
the form 

Eftj[F(Q 12 ,Q 13 ,...)], (9) 

for some function F. For F smooth, we can introduce the random variables q\2, <?i3, • • ., through 
the definition of their averages 

(F(q 12 , qiz, •••)) = Eflj[F(Q 12 , Q 13 , ...)]■ (10) 

Notice that the expectation (•) includes both the thermal average and the average E over disorder. 
The overlap distribution carries the whole physical content of the model fq]. 
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Let us recall some considerations about the overlap distribution. The average E over 
quenched variables introduces correlation between different groups of replicas. For example 
we have, in general, 

The (•) average is obviously invariant under permutations of replica indices (e.g. (q^Qis) = 
(923913)' (I12} = (934))- Moreover, it is invariant under the gauge transformations defined by 

Qab — ► £ a q a b£b, (12) 

where e a = ±1- This is an easy consequence of the fact that each of the lo^ is an even state on 
the respective a^ a \ It follows, for instance, that polynomials in the overlaps which are not gauge 
invariant have zero mean. These symmetries furnish important restrictions on the the overlap 
distribution, but even more important constraints have been given by ||, [Tl[| , using simple 
arguments based on convexity properties and positivity of fluctuations. Consider s replicas, and 
the s(s — 1)/2 overlaps between them. Let us denote by A s the associated algebra of observables. 
Introduce the overlap q a , s +i, between replica a and an additional replica s + 1, and consider the 
conditional probability distribution P( a , s +i)(qa,s+i\-A s ) of q a ,s+i given the overlaps among the 
first s replicas. By adding to the Hamiltonian suitable infinitesimal external fields, and taking 
the thermodynamic limit with a careful procedure, Guerra and Ghirlanda have demonstrated 
that the following theorem holds for a very general class of probability measures, including short 
range models (T^]. 

Theorem 2.1 Given the overlaps among s replicas, the overlap between one of these, let say 
a, and an additional replica s + 1 is either independent of the former overlaps, or it is identical 
to one of the overlaps q a \,, with b running from 1 to s, excluding a. Each of these cases have 
probability 1/s: 

P{a,s+l)(Qa,s+l\A s ) = -Pl2{q a ,s+l) + ~ ^ %<M+1 ~ Qab)- (13) 
S S b^a 



Results of this kind have been obtained by Parisi in the frame of replica method [12|, and 
by Aizenmann and Contucci IR 



3 A generator of overlap distributions. 

Let w be a generic even state on the Ising spins o"i, . . . , gn, possibly depending on the quenched 
variables Jjj and let f 1 : IR — ► IR be an even, convex function, such that \f 1 (y)\ < c\y\ 
asymptotically with \y\ — > oo for some positive c. Let the generating functional iJjn(,w, f x ) be 
given by 

ip N (uj, f\) = Elogw(exp/ 1 (/i A r(CT, J))), (14) 

where h^{a, J) = iV -1 / 2 J2i is the cavity field, and the J«'s are fresh noise with the same 
properties of Jij. The functional /i) contains all informations on the distribution of the 
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replicated cavity fields = h^{a^ a \ J). That, in turn, is related to the overlap distribution 
through the well known formula 

EQj (exp (i Eakah {a) )) = (exp (- £«,6*a*63a&/2) ) . (15) 

We expand the logarithm in power series and we introduce replicas: 



Vw(w, A) = E [ln(l -u(l- exp (f 1 {h))))) 



LXJ -I 

£-E[u,(l- exp (/,(/,)))]* (is) 

8=1 

n(l-eA^ (a) ) N 
a=l 



oo j 



where /i denotes the cavity field and foW its replicas. 

Let us introduce the generalized Fourier transform (j>, which is a well defined even generalized 
function : 

/oo 
dk<p(ky ky (17) 
-oo 

By the convenient replacement (p(k) = 4>(k) exp(— k 2 /2), we finally have 

oo ^ . s 

^Jv(w, /J = ~ / d ' fc II V(*o) (exp (-E( a ,6) k a k b q ab )) (18) 

s=l S J a=l 

where the sum in the exponential is over the couples (a, b), for 1 < a < b < s. The dependence of 
the r.h.s. on f\ is through the function ip. Notice that terms s = 2, 3 contain the characteristic 
functions of the distributions of overlaps among 2 and 3 replicas, respectively. 

It important to notice that the thermodynamic functions can be represented through the 
functional iPn(u, f\). Consider the case f\{y) = log cosh fly, and the corresponding function 
ip* N (fl) = iPn(uj, log cosh/?-), where u is the Boltzman state of SK model. Then the following 
holds §. 

Proposition 3.1 Assume the existance of the limit limjv^oo ip^(fl) = ip*(fl), uniformly on a 
compact region < fl < fl, with ip* continuous in fl, as a consequence. Let us define 



a{fl) = log 2 + / ^{fl^l^q) dq, (19) 
Jo 

so that the fl derivative ct'(fl) exists and the following holds 

a{fl)+fla\fl)/2 = \og2 + ^(fl). (20) 

Then, we have, for < fl < fl, 

lim ±EQogZ N (J3, J)) = a(fl), lim AfyE (log Z N (fl, J)) = a'(fl). (21) 

iV^oo 1\ N^oo iv 
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4 The functional order parameter. 



In the frame of the cavity method, a functional order parameter of Parisi type was introduced by 
Guerra as a functional representation of the marginal martingale function ||. Then, he showed 
that by a simple Ansatz some overlap correlation functions can be expressed in terms of the 
functional order parameter J7|]. 

In this section we give an extension of the representation Theorem, thus obtaining a func- 
tional representation of the physical observables. Exploiting the Ansatz, the generating func- 
tional iPn(u, fi) is expressed in terms of the functional order parameter. Therefore, the explicit 
form of the overlap distribution can be extracted. 

Let us introduce the convex set X of functional order parameters of the type 

x: [0, 1] B q — » x(q) G [0,1], (22) 

with the L 1 ((ig) distance norm. We induce on A 1 a partial ordering, by defining x < x if 
x{q) < x(q) for all < q < 1, and introduce the extremal order parameters xo(<?) — and 
x\(q) = 1, such that for any x we have Xo(q) < x(q) < x\{q). 

For each x in X, and for suitable f 1 (see the previuos section), let us define the function with 
values f(q,y; x,f x ), < q < 1, y E H, as the solution of the nonlinear antiparabolic equation 

d q f + \(f + x(q)f' 2 )=0, (23) 

with final condition 

f(l,y;x,f 1 ) = f 1 (y) (24) 

In (H), /' = d y f and /" = d 2 y f. 

With these definitions, the following representation theorem holds S. 

Theorem 4.1 There exists a nonempty hyper-surface £at(u;, /J in X such that, for any x S 



Etv(w,/ 1 ) and f solution of (^5,24), we have the following representation 

rP N (u, h) =/(0,0; x,h). (25) 



Any family of functional order parameters, x e , depending continuously in the L norm on 
the variable e, < e < 1, with xo = 0, and x x = 1, and nondecreasing in e, must necessarily cross 
Stv(w, A) for some value of the variable e (we say that Y,n(uj, f x ) has the monotone intersection 
property). A similar representation holds also in the infinite volume limit. 

Of particular interest are those states u such that the representation ( p5[ ) holds with some x, 
depending on u>, but independent on f\, with some possible error vanishing in the limit N — > oo. 
We call such states x-representable. Some examples of x-representable states are shown in M. 

An attractive conjecture is that the Boltzmann state of mean field spin glass models is x- 
representable. Indeed, this must be the case if x is the correct order parameter. We will refer to 



6 



this as the tomographic Ansatz : in the X space the hyper-surfaces {£00(0;, fx), fx € Fx} have a 
common point x, which gives the physical content of the theory. By this Ansatz, we can express 
the full probability distribution of overlaps in terms of the functional order parameter. Let us 
state the following theorem, one of the main results of this paper, leaving the proof to the next 
sections. 

Theorem 4.2 Let lo be an even state on the Ising spin variables depending on the quenched 
variables J, and suppose it is x-representable, with x(0) = and x(l) = 1. Then the following 
holds. 

a) The probability distributions of overlaps among s = 2, 3 replicas are given in terms of the 
functional order parameter x by the following expressions : 

Px2(q) = P(q) = ^x(q), (26) 
^12,23,13(912,923,913) = ^(912)^(912)^(912-923)^(912-913) + 

+ - {P{qn)P(q23)0(qi2 - 923)^(913 - 923) + cyclic perm.j(27) 



b) Assume in addition the hypothesis of Theorem 2.1. Then the overlap distribution is 
uniquely determined in terms of the functional order parameter x, and the s-replicas 
marginals (i.e., the distribution of overlaps among s replicas) can be given explicitly for 
any s (see section®. 

We have used Dirac's 5 function and the step function 9. Extension to regions of negative g's 



is made by gauge symmetry, as shown in the next section. Equation (26) gives the physical 



meaning of the functional order parameter; equation (27) corresponds to ultrametricity of the 
overlap distribution, as is proven in the following. For other values of x(0) and x(l), slightly 
different results can be obtained. 

As is shown extensively in the next section, ultrametricity arises naturally as a consequence 
of the branching diffusion process underlying equation ( p3| , p4|). 

All results are in full agreement with those found in the frame of replica symmetry breaking 
method with Parisi Ansatz Q. 

5 Asymptotic solution of the antiparabolic equation. 



The results (26,27) of Theorem 4.2 are obtained by equation ( |25| ), and the tomographic Ansatz. 



Both members of equation (£5|) are expressed as asymptotic series, which are then compared 
term by term. The first one is given by equation (|i~8|), the second is obtained in this section. 
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Let us transform equation (23, 24) 

d q f q + l(f«+x q f' q 2 )=0 

/(l,2/;a,A) = A(y) 



into an equivalent form. When x(0) = and x(l) = 1, satisfied by physical order parameters, it 
is convenient to make the substitution 



9q (V) = [1 - exp ( Xq fq(y))] /X q 

the x and f 1 dependence of / being understood. The resulting equation is 

9q 9q + ^ g'q = Pq [Xg 9q + (1 ~ X q g q ) ln(l - X q g q )] / x\ 

g(i,v,z,fi) = 9 Ay) = 1- exp (A (2/)) 



(28) 



(29) 



where x q = x(q) and p g = dx q /dq. Notice that the final condition for g is equal to the function 
used in the expansion of ippf(cj, f\) (eq. [IB]), and that <?(0, y) = /(0, y). Let us re-write equation 
(p9]) in integral form: 



5, = iVi-g *gi+ [ dq' ^ N q'~q * [ X Q' 9q' + (1 ~ <V ity) M 1 ~ <V 9q' 
J a X i 



(30) 



as one can straightforwardly see by simple inspection. Here N q = N(q, y) = exp (—y 2 /2q) /^2irq 
is the usual heat kernel and the symbol * is the convolution operation on y variable Q. 

Equation (30) can be handled by asymptotic expansion of the r.h.s. term under square 
brackets : 

i r 1 , , u-2) 



9q = Nl-q * 91 + 



i=2 i(i ~ 



dg' p 9 ' xt N q i- q * (g q >) 



(31) 



We write the above equation in the "moment space" : let r/ q be the Fourier transform of N q * g q 
in the y variable and ip that of N\ * g 1 . Thus we have, after simple algebraic manipulation 



Vz = fz + F z [ry] 



(32) 



where z is a collective variable for (q,k), <p z = <p(k) is the same function appearing in eq. (15) 
F z [rj] is a function of z and a functional of rj 



i=2 



(33) 



l {f*g)(y) = fdy'f(y-y f ) ff(2/') 



8 



and the 2 are well denned multi-linear integral operators 



6* [v>i > • • • , v<] 



= (i - 2)! / d*fc (5(fc a +... + ki-k) fl ^a(fca) 

a=l 

/ dq'p q , x/~ 2 exp(-q' £ k a k b ) 



(a,6) 

Every term in the asymptotic expansion is well defined. Notice that the representation Theo- 
rem 



4.1 can be rephrased as 



i> N {u,fi)= -g(0,0) 



dk r)(0,k) 



(34) 



and this is the form that we will use in the sequel. 

The i— th functional derivative of F z [rj\ w.r.t. r/ calculated in zero gives the integral kernel of 
the 6j operator. In particular 



lr?=0 



?7=o 



Replacing rj = ~L[(p] in (32) we have 

L z [<p] =^z + F z [L[<p]] , 
which defines iteratively the inverse functional L z [ . ] : 

OO -1 „ s 

l>] = £ -r / d l fc J] ¥>(M 4° (to. • • • > fc- 

-.S.J 
s=l a=l 

It is easy to check that 

SL Z [<p] 



(35) 



(36) 



(37) 



L, ML=o = ° 



v>=o 



(38) 



where S z - W is the usual Dirac's function, and that, by derivating ( p6| ) w.r.t. 99 



Mi 



(39) 



Subsequent functional derivatives w.r.t. <p, calculated in ip = 0, and the properties ( |35| ) and ( |3q ) 
allow us to obtain straightforwardly all the integral kernels L z s \k±, . . . , k s ) for any s, in terms 



of 2 operators. We thus obtain 



r 00 1 r s l 

/ dk V (0, fc) = £ - / d s k J] <p(k) 7 tttL^i, • • • , fc.) 



(40) 
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where L^\ki, . . . , k s ) are the integral kernels, calculated for q = and integrated on the overall 
delta dependence in the k variable. They are of the form: 

/ ~ fw L o S) (h, - ■ ■ ,h) = J Y[ dy«fe P s +) ({yab}) exp (- E( a , 6 ) k a k b y ab ) (41) 

(a, ft) 

where /0g +) has support on a subset of [0, l] s ( s_1 )/ 2 . In appendix we report the explicit expressions 
of p s + \ for s = 2,3,4 and the recipe to construct it for a generic s. 



By eq. ( p4| ) we can compare the asymptotic expansions in eq. (|18| ) and eq. (f40[). As the 
function <£>(&) is even, only the even part in the k's of integral kernels from both sides can be 
equated. Let us define on [— 1, l] s ( s_1 )/ 2 the function p s , extending by 'gauge symmetry' the 
function 

PsdYab}) = 2- s J2ps + \{£ay a b£b}) 

= 2-^) PT ({eayabSb}) (42) 

where the sums run over all the e a = ±1, a = 2, . . . , s and = if its argument is outside 
[0, l] s ( s_1 )/ 2 ; we have used the invariance e a — * —e a to fix e\ = 1 in the second line. We finally 
have 

(exp {- J2(a,b) k ahlab) ) = / JJ d ^ ab Ps({Yab}) exp (- J2(a,b) k a k b yab) (43) 

(0,6) 

which proves part a of Theorem 4.2. 

For s > 3 the l.h.s. of eq. (|43| ) does not correspond to the characteristic function of the 
overlap distribution, as the number of the fe's parameters is not sufficient, but to its restriction 



on a hyper-surface of dimension s. In the next section, assuming the hypothesis of Theorem 2A , 
we show that the results obtained so far allow us to construct the full overlap distribution 
function. The resulting s = 4 overlap distribution coincides with p s . This is a strong indication 
that p s is the correct distribution also in the case of no additional interactions, as required by 



Theorem 2.1 



For a generic s the distribution p s has the ultrametric form 

Ps{{y a b})= £ Pi p ( : \{yab}\Ai) (44) 

i:Af CA S 

Here Af are disjoint sets, made by portions of hyper-planes in [— 1, l] s ( s ~ 1 )/ 2 ) with dimension 
I Af \ < s — 1; A s is the union set; pi are positive numbers, which sum to one, and p s (■ ■ ■ \Af) are 
probability densities, whose supports are the sets Af. The r.h.s. can thus be interpreted as a 
composite probability formula: p, is the probability that the ultrametric event Af happens and 
p s {■ ■ ■ \Af) is the overlap probability, conditioned to Af. The events Af are disjoint and each 
p^ effectively depends only on at most s — 1 variables. 
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6 Ultrametric distributions. 



Consider the set <3? of random variables q a ^ £ [— 1 , 1] : 

$ = {la,b, (o,6) e 93 c C}, (45) 

where C is the set of couples (a, 6) of natural numbers a,b £ IN, a < b. To the set are then 
associated a probability space and the probability distribution Pp(<&) on it. The distribution 
functions P v satisfy the consistency conditions 

J P VtV ,($, I] d?« = P v (*), (46) 

for all disjoint sets tp, <p' C C. In the following we will often write {A, B} = AUB and ab = (a, b) 
when not ambiguous. Let us introduce the operator Hi tTn that, acting on ip, permutates the 
indices I and m. E.g.: ni 2 {(l,2), (2, 3)} = {(1, 2), (1,3)}. Let ip' = TL hm (p, and denote by the 
associated set of q's. According to the symmetries of the (— ) average, we ask the probability 
measure P to be gauge invariant, and symmetric under permutations of indices, in the following 
sense: 

iV(*0 = P V&) = P v(Pl,m*') = (Kl,mP<p) (*')■ ( 47 ) 
This defines the operator IL/ im on the space of distributions. 

Let us consider a very particular class of distributions for the overlaps between three replicas, 
i.e., the ultrametric distributions : 



P 12,23,13 (912, 923, 913) — 


B(q 12 


923) # 


(912 


- 923^ 


%13 


- 923) 


+ 


-6(923 


912)0 


(923 


- 912^ 




- 912) 


+ 


B(qi 3 


923)0 


(913 


- 923} 


5(912 


- 923) 



(48) 

where B is a distribution. This simply states that among the three overlaps, two are equal 



and the third is greater or equal. From eq. (48), a simple application of symmetries and of the 
consistency conditions (fi6"|) , leads to 

Proposition 6.1 If the distribution ^12,23,13 has the form ((8), then for any tern of replicas, 
(a,b,c), the operator T a ,b,c is defined such that 

Pab,ac,if ~P %,b,c(.Pab,ipi Pac,tp)i (49) 

where (p C C, (6, c) 6 (p and (a,b), (a,c) ip. The operator J- a ,b,c is defined through its values 

Fa,b,c{Pab,<pi Pac,ip) (<lab, 9ac! 3>) = 
= Pab,<p{<lab\ $) [%a& ~ 9f>c)%a C ~ qbc) + %fcc ~ q a b)S(q a c ~ Qab)] + 
+ Pacwiqac, *) %ac - qbc)5{q a b ~ qbc) 

- S(q a b - qbc)o~(q a b - q ac ) J P a c, v (q a c; ®)0(q a c - qbc) dq ac - (50) 
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Note that when the set (p is symmetric under permutation of indices b, c, we can introduce 
the operator T a f>,ci 

Pac,ip> = ^a,b,c(Pip') = Fat>,c{P^> > H-b^P^ 1 ), (51) 

where ip' = {(a, b), ip]. 

This property of the overlap distribution corresponds to ultrametricity. In fact, eq. (|50| ) 
simply states that for any triangle of overlaps in a given set (p, two overlaps are equal and the 
third is greater or equal. The proof of the theorem and of the subsequent lemma as well, does 
not depend on the nature of the </ v variables, but only on symmetries and general properties of 
probability spaces. 



Lemma 6.2 In the hypothesis of theorem 6.1 we can express the probability distribution of the 
overlaps between s + 1 replicas in terms of the distribution of the overlaps between s replicas and 
qi, s +i (for s > 3). 

The proof goes as follows. Given s > 3 and I < s, we define the set (p s j by 

<Pe,l = {(a, b), l<a<b<s}U {(c, s + 1), 1 < c < I}, (52) 

such that the following simple relations hold: 

{(I + l,s + 1), ip s j} = ipsj+x, (53) 
(Ps,s = <Ps+lfl- (54) 

Applying formula (|5l|), with / + 1 < s, we have 

Pip a ,l +1 = P(l+l,8+l),<p ail = ^8+l,l,l+l(P<p a> l)- (55) 

By iteration we have the thesis 

P<p a+ i,o = Fs+i,i,a ■ ■ •-^s+1,1,2 (Pfs,i)- (56) 
Moreover, by definition of conditional probability we have 

Pfs,l = P(i,s+i) P<p B ,o> (57) 
where Pn s +i) is given by eq. (^3|) . Therefore we have proven the following 

Theorem 6.3 If the 3-replicas overlap distribution P12 23,13 is ultrametric (i.e., of the form 
mB)), and in the limits of validity of theorem 2A, the overlap distribution is uniquely determined 
in terms of Pyi- The explicit form of the distributions of overlaps among s replicas, for any s 
(i.e., the s-replicas marginals P^ s0 ), can be calculated by repeated applications of eqs. (5^,57). 
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Since Theorem |4.2| ,a proves the hypothesis of Theorem 6.3 in the case of mean field spin 
glass models, this completes the proof of its part b. 

I) clearly shows that ultrametricity and the Ghirlanda- 



The explicit construction (56 



Guerra relations can be considered as complementary in order to determine the full overlap 
distribution, in the sense that one can hold independently of the other, but together they 
determine explicitly the overlap measure in terms of the one-overlap distribution. 
Results of this kind were obtained by Parisi in the case s = 3 [H! 



7 Conclusions 

It has been shown how mean field disordered models can be successfully analyzed in a math- 
ematically rigorous framework, with a simple Ansatz which is completely different from the 
Replica Simmetry Breaking Ansatz . In the S.-K. spin glasses case, the main features of the 
accepted physical solution - the Parisi solution - have been obtained. The method exploited, 
due to F. Guerra, is based on the cavity method and general theorems, and can therefore be 
applied to other disordered mean field models such as the multi-spin interaction spin glasses or 
neural networks. 

The functional order parameter x(q) has been introduced in the S.-K. model. By the Ansatz 
that x is indeed the correct order parameter, all physical observables have been expressed in 
terms of it. The physical interpretation of the functional order parameter (i.e. dx{q)/dq = 
P(q)) results, and ultrametricity of overlaps is derived as a natural consequence of a branching 
diffusion process. 

It has been shown by explicit construction that ultrametricity of the 3-replicas overlap dis- 
tribution together with the Ghirlanda-Guerra relations determines the distribution of overlaps 
among s replicas, for any s, in terms of P\i. 
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8 Appendix 

We report the explicit expressions of ({jab}) for s = 2,3,4. For two replicas we have 

(+) f 1 

P2 (yi2) = / dq p(q) S(y 12 - q) (58) 
Jo 

for three replicas 

1 

P3 +> ({ya4) = 2 / d Q P(<l) X (-l) II + 
° (a,b)cG 3 

i r 1 . r 1 



2 



X) (3) / d? / dq' p(q)p(q')5(y^ 2 -q') JJ ~ 9) 

' (a,6)cG3\(7ri,7r 2 ) 

(59) 



and for four replicas 
p 4 + ({yab}) 



1 Z" 1 

- y dq p(q)x 2 (q) J[ 6(y ab - q) + 



(»,6)CG 4 



^ pi pi 

+ 7 E / ^ / dq' p(q)x(q)p(q) 5{y ni7T2 - q) JJ 5(y o6 - g) + 

T ° 9 (a,fe)CG 4 \(7r 1 ,7r 2 ) 



1 E W /' d 1 t dq' p{q)p{q')x{q') J] ^ " <?') x 

* ° 9 (a,6)cG 3 (7ri,7r2,7r3) 

II £(y a &-s) + 

(a,ft)cG4\G3 (771 ,772,773) 



+ l E (3) jf ^ / # / dq" p{q) P {q')p{q") 5(y^ 2 - q')5{y w - q") x 



l r 1 r 1 r 1 

■ dq' J 

Iq Jq 

II 5(y ab -q) + 

(a, 6)cG4\{(7ri,7T2), (773,774)} 



+ J E (12) /' d i t dql r tf'pbWW) s(y^ 2 -q") X 

6 ^ Jo -V 

x n *(yob-9 / ) II ^(yafe-g) 

(a,6)cG3(7ri,7r2,7T3)\(7Ti,7T2) (a, b)cG4\G3 (771,772,773) 

(60) 

Here G r (ii, . . . ,i r ) is the complete graph with vertices . . . , i P ) C {1, • • • , s} 0; ^77 ^ indicates 
the sum on all different n permutations ir on G r vertices' indexes, which render permutation in- 
variant the associated measure. The numbers pi, the probabilities of different ultrametric events, 
2 clearly G s = G 3 (l, . . . , s) = ip s>0 
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are obtained by normalizing the corresponding measures; counting together the permutations of 
variables they are, for three replicas, (1/4,3/4) and for four replicas (1/9,1/6,2/9,1/6,1/3). 

The recipe to construct p^ +> ({y a b}) is based on the costruction of abstact trees with a root and 
s "leaves" , which carry the indices y a b The is given by a sum on all such trees constructed by 
elementary branchings: each element in the sum is an integral on at most s — 1 variables of the 
weight wt{ ■ ) associated with the tree T. For T given, wt is the product of the combinatorial 
factor [(s — l)!] 1 times the weights of the branchings forming the tree ^] and suitable 9 and 
5 functions on the integral variables and the the output variables y a fc, according to the tree 
structure. 

A simple way to deduce the number of structurally equivalent graphs, goes as follow: 
we use a scale transformation in (]36| ) to obtain the generic term L« [<p, . . . , tp] in terms of 
{L( s ') [ip,. . . , (p\y, for 1 < s' < s in the expansion of L z [ip] = J2 [tp, ...,</>] /s\ . Let ip — > A tp 
be this scale transformation: it is L z [<p] = ip z and, for s > 2 

s=2 b - i=2 

By multilinearity of the operators, equating terms with equal powers of A, we have 

i=2 {rrij} 

the sum J2'{ m } 1S on an m j — ^ with the bounds J2j 171 j = * an d J2j j m j = s ! (LjM)' 7 ^ is briefly 
for rrij repetitions of ~Lj[ip] operator as argument of 2 and finally (S) is the symmetrical factor 
in the 92's given by 

si 

~~ mi! • • • m s _i! 2!™2 • • • (s - l)! m =-i ^ j 

which counts all structurally equivalent graphs. 



OO \S,— 1 OO \Sj— 1 

E^'M ( 61 ) 



s,; =2 



(l (1) [^]) m i,...,(L^ Mr- ) 



(<?1 



(62) 



3 a branching formed by an input and, say, i outputs, has a weight Wi(q) = (i — 2)1 p q x q ' 
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